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by 
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During  the  past  decade,  selection  and  ranking  theory  has  developed  rapidly. 
Many  reasonable  rules  have  been  proposed.  Some  good  properties  have  been 
studied.  However,  very  little  work  has  been  done  to  consider  the  optimality 
of  a selection  procedure,  especially  in  the  subset  selection  approach.  In  this 
paper,  we  are  interested  in  working  on  some  results  for  optimality.  Some 
classical  selection  rules  are  constructed  as  special  cases. 

Let  -s  denote  a partial  ordering  on  the  k-dimensional  Euclidean  space. 

Let  = (Xj,  , . . . ,XjJ  and  0_  = ( 0 ^ , . . . ,6^) , and  x_  •<  x_ ' be  defined  by,  < xj, 
i < i _ k;  similarly,  0_  ■<  _6'  « 1 _f_  i k.  A measurable  subset  S of  the 

sample  space  is  called  monotone  non-decreasing  (with  respect  to  ■<  ) if  x_  € S 
and  x_  < £*  implies  _x'  fc  S.  Let  Pg(S)  denote  the  probability  measure  of  S under 
the  conditional  distribution  of  X given  0_.  The  distribution  is  said  to  have 
stochastically  increasing  property  (SIP)  in  6 if  P (S)  < P_,(S)  for  every 
monotone  non-decreasing  set  S and  all  0 -<  O'.  A function  cg(x)  is  said  to  be 
non-decreasing  (with  respect  to  ■<  ) if  cpQO  <_  cp(x_')  for  all  x^  < x'.  Let  E^ 
denote  the  expectation  with  respect  to  the  distribution  Pn. 

A characterization  of  SIP  is  given  by  the  following  lemma  (for  proof  see 
Lehmann  [5],  p.400;  or  see  Alam  [2]). 


★ 


This  research  was  supported  by  Office  of  Naval  Research  Contract 
N000 14-7S-C-04S5  at  Purdue  University.  Reproduction  in  whole  or  in 
part  is  permitted  for  any  purpose  of  the  United  States  Government. 


Lemma  1.  A family  of  distributions  P,  has  SIP  in  o iff  H ,>(XJ  < E , ij/(X)  for 
all  non-decreasing  inferrable  function  'f(xj  and  all  0 ■<  u ' . 

It  is  easy  to  generalize  Alam's  result  in  [1]  as  follows. 

Pheorero  1.  _ I.et  the  distribution  of  X_  have  stochastically  increasing  property  in 
and  let  k(x_,j)  be  non-decreasing  in  and  B_.  Then  Eg«f(X_»_6)  is  non-decreasing 
in  0. 

Proof.  Let  j)  < _0' . From  the  fact  that  E^cp(X_,_e)  _<  EgCp(X_,_0')  and  Lemma  1,  we 
know  that  E cpfX_,_0' ) _<  E Qt  cp(X_,£' ) . This  completes  the  proof. 

Remark  1 . It  should  be  pointed  out  that  the  dimensionality  of  the  vectors 
x and  0.  need  not  be  the  same.  The  above  results  are  true,  in  general. 

There  are  given  k populations  v ^ ^ , . . . .r  of  which  we  wish  to  select  a 

subset.  The  quality  of  the  ith  population  is  characterized  by  a real-valued 
parameter  Let  U denote  the  whole  parameter  space. 

Let  5 be  a selection  procedure  and  let  R03,5)  and  S(0,6)  be  some  quantities 
such  that  S(0_,  6)  is  large  and  R(0_,  6)  is  small. 

Lehmann  [7]  has  proved  the  following  result. 

Lemma  2 . Let  0 be  a o-field  of  subsets  of  the  parameter  space  Q and  let  X and 
y be  probability  distributions  over  (12,0).  Let  A,B  be  two  positive  constants 
and  let  6^  maximize  the  integral 

(1)  b/s(Q_,  i)dy(9_)-A/R(£,6)dX(0_) . 

Then  5^  minimizes  sup  R(6_,  3)  subject  to 

(2)  inf  S(j£,6)  >_  y 
nrov ided 

(3)  /R(h,40)dX(0)  = sup  R(6_,  6^) 

and 

(4)  yS(£,60)du(0_)  = inf  S(u_,60)  = y. 


ij 
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Let  - it.-t  > t_,  j*i;,  i • i < k,  be  a partition  of  a such  that 
i — 1 1 j — 0 - — 

k 

- j ....  Let  be  a distance  between  * . and  ir . x.  = (t  . , , . . .t  .,  ) with 
,r.o  1 U 1 J — i v 1 1 ik 

k-1  elements  (since  i..  is  not  considered!,  t . . and  t_  are  known  constants, 
k 11  nO 

Let  Q = J A.  and  >.  = min  x.  and  let  r.  = max  t„  be  associated  with  it. 

1 1 1 j*i  1J  J l<Kk  1 J 


which  we  call  the  best. 


Let  4 = (5,,..., 


5k)  and  S(t_,6j  = S(x_,6.)  = Pt  (Selecting  ni  I 6i  ' = /6iPT  if  t_&2.  , 


1 • i k.  Let  = P, (Selecting  Tt.jfi  },  if  t£S2,  and  R(t_,  6)  = 

k 

R ■ J (*,*.).  Let  2..  be  a sufficient  and  maximal  invariant  statistic  for 
i=l  “ 1 1J 

1 ^ i,  j k,  j^i.  We  know  that  the  distribution  of  , depends  only  on 

- . ( see  [(>]  ) . 

l j 

Oostcrhoff  [8]  defines  a monotone  likelihood  ratio  density  for  a random 
vector  X_  with  m components  as  follows:  Let  be  an  m-dimensional  vector  of 

k 

parameters.  A partial  ordering  of  points  in  R is  defined  by  x1  < x,  meaning 

4 

x.’  ^ x.  for  i = l,2,...,k,  and  the  inequality  is  strict  for  at  least  one 

component.  The  density  f(x_,0)  has  monotone  likelihood  ratio  if  for  all 

2"  ■<  !±'  • [ f (x_. 0 1 )/f  fx.»£")  ] is  non-decreasing  in  x. 

Let  the  joint  density  of  Z.  . , j^i,  be  p^  (z_^) . Let  p^  be  denoted  by  p 

1 J — i 1 — i 

when  t..  = ...  = t . , = t . . and  byp.  when  t . . = ...  = t . . = t _ , i.  > t . . . 
il  ik  it  ' *i  il  ik  0’  0 li 


Restricted  Minimax  Selection  Procedures 


Theorem  2.  Suppose  that  p^  (z_)  has  monotone  likelihood  ratio.  Assume  that  the 
supremum  of  R(t_, 6^)  over  Q occurs  at  t . ^ = x„  for  all  i,j,  where  for  any  i, 

. Pidi) 

( 1 if  X r - > C , 

^0  — i 


0 


< 


4 


where  c and  a ire  determi ned  by 

t , U 


Then  VJ  minimizes  sup  subject  to  in£  S(t_,6)  Y . 

1 k r_ai 

Proof.  Let  A he  the  distribution  which  assigns  probability  one  to  the  point 

t = (t  ^ . ) and  „ the  distribution  which  assigns  probabil ity  i to  the 

points  = ( 1 q > • • • >T q) • Then  by  Theorem  1,  we  have 

inf  = min  inf  = min  S(t^,6^) 

t_G..  l^i<k  t€  d . lfifk 

1 t'  f 0 ft'/  x 0 . i r a 

= k L I\P{  = LMl*6  ^(L). 

i = 1 ii 

(since  /i^p.  = Y,  1 d i 1 k) . 

sup  R(t_,  = / ( 6 j*  + ...  + p0>  and 

t€.„ 


hence  (1)  reduces  to 

(5)  R / S ( r , c ° ) ' 


B/_S(i,6°)du(e_)-A/R(T_><5°)d\(e) 


R e / 0 . r ;,0 

= k . i-  /Vi-\I  /Vc 

1=1  1=1 


r V A°rB  * . 

= / } Vk  Pi-Ap0) 
1 = 1 


Since  0 ' 

< 1,  f 3) 

is  maximized 

i — 

k 

i.xample . 

Let  fi.fx)  = 

— 

J = 1 i 

W 1 

1 J 1 k,  Jt' 

• Tu  = n'  To 

tTll 

t ) and  z . 1 
i k -l 

= (zil Z 

rO  ^ . B 

3 . = 0 or  1 as  r-  P • < 

i k 1 i . 

K T ^i-V 


ij  i J 


k-l  1 


\ 2 in  “ cxp,'-f£i-ii) 


where  } 


1 .2 . 1 


(k-l)x(k-lj 


— 9)  is  the  positive  definite  covariance  matrix 


of 


2 . . ' s . We  know  that 
ij 


P : f i. : ) „ _ 1 i i i 

= exp{z.'  > A + A'  ) z • - A ) A} 

Pq^J  -a  L ~ - L -i  - L - 

is  non-decreasing  in  z.^,  j 4 i > and  is  equivalent  to 


k-1 


iii 


vc- 


We 


0, 


= ...  = 0, 


e can  show  that  the  supremum  of  R(t_,£  ) over  Si  occurs  at  9^  = 

Note  that  the  above  is  the  Seal's  procedure  [9]  to  select  a subset  containing 
the  population  associated  with  the  largest  6^’s,  so  called  the  "best"  population. 
An  essential  complete  class  of  multiple  decision  procedures. 

A point  Xq  is  called  a change  point  for  a function  h if  in  some  neighborhood 
of  xn> 

lifxjhfx*)  <_  0, 

whenever  x <_  xQ  ^ x*  , and  for  some  x^  xQ  <_  x*,  h(xp4o  and  h(xp4o  with  xpxp 
Karlin  and  Rubin  [4]  have  proved  the  following  result. 

Lemma  3 . If  9 changes  sign  at  most  once  in  one-dimensional  Euclidean  space  R1 , 
then 

v(w)  = /pfx  |w)cp(x)da(x) 

changes  sign  at  most  once,  where  u is  a o-finite  measure  on  R'  and  p(x|w)  is  the 
density  of  X with  monotone  likelihood  ratio  (MLR). 

Remark : It  is  useful  to  note  that  ifr  changes  sign  in  the  same  direction  as  ^ if 

it  changes  sign  at  all. 

A decision  rule  d(jy)  is  called  monotone  if 

, 1 

0 otherwise. 


dfx)  = 


if  x > V 


1 


■ .•■LAJWt  HI  J,U 


Let  F be  the  continuous  distribution  function  of  the  pdf  p^.  (z_)  for  any  vector 
t,  and  let  I-  1 f y ) be  the  supremum  of  the  set  (x;  F (x)  = y)  with  respect  to 


T — 


the  partial  order  for  any  real  y and  t. 


Let  6.  be  any  non-monotone  rule  and  for  any  given  real  vector  b.  = 


— 1 


(b  , . . . ,b  . j.)  with  k-1  elements,  such  that 

RJ(_V  j)  = /(l-^fc.iip.  (1.)dvfc.), 

— i 

where  v is  a e-finite  measure  on  k-1  dim.  F.uclidean  space  R 

1 if 


k-1 


Let 


6°(z.)  = 

1 — 1 


Fb‘  (R’tK.Sp), 
—1 


0 


otherwise . 


Then  R^b.  ,o.J  = /(1-6?) pb  (^jdvf^. ) 


"I  1 


Fb!(R'(-i,V) 

j 1 Pb  (z_i)dv(z_.)  =Rx(b.,<5.). 

- " — i 

Suppose  that  i ^ is  not  monotone  in  z.^,  for  fixed  z^,  . For  each  fixed 


z.  , f^4j)  define  6°(z.)  as  above  is  monotone  in  z..,  and  to  satisfy 
1 **  1 — 1 1J 

Rl(b.  ,6°)  = R1 (b. , 6.) . And 


-l  i -l  i 

rVt.  >60)-R1(t.  ,6.) 

—l  i —l  l 


= /[<51-<5i]PT  (z^Jdufz.  .) 


0 . 


Since  6 is  monotone,  6.-6.  as  a function  of  z . . has  at  most  one  sign  change  i 
l ii  ij  ° ° 

the  order  of  plus  to  minus.  Using  this  fact,  the  MLR  of  pt  (£.)  and  Lemma  3, 

— i 

wc  have 

RX(t. ,6°)  < R1(t. ,6.)  for  t. . > b. .. 

-i  i - —i  i ij  - ij 

Hence  Ri(x,6°)  < R^t.i.)  for  i > b.. 

— l — —ii  —l—i 

As  the  normal  means  example,  a monotone  procedure  is  the  following  form: 

1 
0 


in 


■ { 


if  z . > C , 

—l  — 


otherwise,  C = (Chjy^i), 


1 
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